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We study a class of optimal allocation problems, including the well-known Bomber Problem, 
with the following common probabilistic structure. An aircraft equipped with an amount x 
of ammunition is intercepted by enemy airplanes arriving according to a homogenous Poisson 
process over a fixed time duration t. Upon encountering an enemy, the aircraft has the choice 
of spending any amount < y < x of its ammunition, resulting in the aircraft's survival 
with probability equal to some known increasing function of y. Two different goals have 
been considered in the literature concerning the optimal amount K(x, t) of ammunition spent: 
(i) Maximizing the probability of surviving for time t, which is the so-called Bomber Problem, 
and (ii) maximizing the number of enemy airplanes shot down during time t, which we call 
the Fighter Problem. Several authors have attempted to settle the following conjectures about 
the monotonicity of K(x,t): [A] K(x,t) is decreasing in t, [B] K(x,t) is increasing in x, and 
[C] the amount x — K(x, t) held back is increasing in x. [A] and [C] have been shown for the 
^ Bomber Problem with discrete ammunition, while [B] is still an open question. In this paper 

we consider both time and ammunition continuous, and for the Bomber Problem prove [A] and 
[C], while for the Fighter we prove [A] and [C] for one special case and [B] and [C] for another. 
These proofs involve showing that the optimal survival probability and optimal number shot 
down are totally positive of order 2 (TP2) in the Bomber and Fighter Problems, respectively. 
The TP2 property is shown by constructing convergent sequences of approximating functions 
through an iterative operation which preserves TP2 and other properties. 
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1 Introduction 



Throughout this paper we write decreasing for non-increasing and increasing for non-decreasing. 
When we use strict monotonicity, we will say so explicitly. The allocation problem discussed in 
this paper can be described in terms of the following example: an aircraft, which is at flying time t 
away from its final destination, is equipped with an amount x of ammunition. It is confronted by 
enemy airplanes whose appearance is driven by a time-homogenous Poisson process with known 
intensity. By adjusting the units of time, we assume without loss of generality that the intensity is 
one. It is assumed that the encounters are instantaneous, that is, that their duration time is zero. 
The question of interest is how much of the presently available ammunition should be spent when 
confronted by an enemy while in "state" (x,t). We consider two problems, the Bomber Problem 
and the Fighter Problem, with this common probabilistic setup. For the Bomber Problem, the goal 
is to maximize the probability P(x,t) of reaching its destination. For the Fighter Problem, the 
goal is to maximize the expected number N(x, t) of enemy airplanes shot down. In both problems 
there is given an increasing function a(y) which, in the Bomber Problem is the probability that 
the Bomber survives an enemy encounter in which it expends < y < x units of its ammunition, 
while in the Fighter Problem a(y) is the probability that the Fighter destroys an enemy when it 
expends y units of its ammunition. Although our results below are proved when a(y) is general, 
the canonical example considered in the literature for a(y) in the Bomber Problem is 

1 - (1 - u)e- y (1) 

for some fixed u G [0, 1], which can be interpreted as the Bomber's y units of ammunition destroying 
the enemy with probability 1 — e~ y , while otherwise allowing the enemy to launch a counterattack 
which succeeds with probability 1 — u. 

For the Fighter, where a(y) is the probability of destroying the enemy, the probability that the 
Fighter survives an encounter is a(y) + u(l — a(y)), since the enemy is hit with probability a(y), 
and otherwise, with probability 1 — a(y) the enemy counterattacks, and misses with probability u. 
When taking the canonical choice a(y) = 1 — e~ y , the Fighter's survival is given by 0. 

While the optimal ammunition spending strategies K(x, t) may differ for the Bomber and Fighter 
Problems, it is perhaps intuitively obvious that the following three monotonicity properties, first 



posed by Klinger and Brown (1968) for the Bomber Problem, should hold for both: 



[A] : K(x,t) is decreasing in t. 

[B] : K(x,t) is increasing in x. 

[C] : x — K(x,t) is increasing in x. 

Roughly speaking, [A] states that the closer one is to the destination, the more one should spend, 
[B] states that the more ammunition one has, the more one should spend, and [C] states that the 
more ammunition one has, the more one should retain for possible future encounters; replacing 
"more" by "not less" makes these characterizations precise. Although we write K(x, t) for the two 
different goals, no confusion should arise, as it will always be clear which of the problems we are 
discussing, or that we are discussing them simultaneously. An optimal policy may not be unique. 
If it is not unique, K(x,t) will always denote the minimal optimal amount of ammunition needed. 

Although the paper is written in plane English, the settings above serve only as illustrations of 
the general method which can be applied to a wide class of problems where some limited resource 
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needs to be optimally allocated over time or space to maximize the probability of a system's survival, 
which clearly also have more peaceful applications. 

Of the two problems, the Bomber Problem has received most attention. For discrete ammunition, 
such as missiles, it is first treated in Klinger and Brown ( |1968 ), who prove that [B] implies [A]. A 
clearer picture emerges in |SamueI (1970), who proves [A] without assuming [B]. Samuel's (1970) 
formula (3.9) also proves [C]. Conjecture [B] has remained elusive, and in fact remains in doubt. 



Simons and Yao (1990) argue that when both time and ammunition are continuous, then [B] is 
equivalent to the log concavity of P(x, t) in x for each fixed t. They also show that when both time 
and ammunition are discrete, there exist parameter values for which log concavity fails. However, 
they are unable to supply an example where [B] fails. 

Regarding the Fighter Problem, we are unaware of this variation on the Bomber Problem being 
discussed in a finite time t horizon setting. For an infinite time horizon, an optimal policy can be 



written simply as K(x). Weber (1985) shows that the monotonicity of K(x) fails to hold for discrete 
ammunition when a is given by (|lj) with u = 0, and Shepp et al. ( 1991[ ) show that monotonicty 
fails for continuous ammunition. In a setting where both ammunition and time are discrete, the 
duration T is an unknown exponential random variable with known mean, and geometric arrivals 



of the enemy, Shepp et al. (1991) also show that there exist parameter values for which [B] fails. 
Though this variant is on a finite time interval of length T, the optimal policy does not depend on 



t and so resembles an infinite time horizon problem. On the other hand, Bartroff et al. (2010) show 



for the Bomber Problem with continuous time and ammunition that there exists a certain region 
of the (x,t)-space over which K(x,t) = x, a monotone function of x, and hence [B] holds in this 
region. 

In the present paper we consider the "doubly continuous" setting where ammunition and time 
are continuous variables. Given an increasing function a(y) taking values in [0,1], the dynamic 
programming equation for the Bomber Problem giving the optimal survival probability P(x, t) is 



P{x,t) 



sup a(y)P(x — y,t — s)e s ds + e 1 

o o<y<x 



for (x,t) Gl + x 



where 1R + = [0,oo). The explanation is as follows. There are no encounters in a time interval 
of length t with probability e~*, yielding the final term. Otherwise, an encounter occurs at time 
s G [0,i] with density e~ s , at which time the amount y G [0, x] will be chosen to maximize the 
probability a(y) of surviving the current encounter times the probability of future survival under 
an optimal policy. A simple change of variables yields 



P(x,t) = / sup a(y)P(x - y,s)e ( * s) ds + e 1 for (x,t) G 

JO 0<y<x 



(2) 



Given an increasing function a(y) taking values in [0, 1] and a fixed value u G [0, 1], the dynamic 
programming equation for the Fighter Problem giving the optimal expected number N(x, t) of 
enemies shot down is 



N(x,t) 



sup {a(y) + [a(y) + u(l - a(y))]N(x - y,s)}e~ {t - s) ds for (x, t) G 1R + x IR + , (3) 
o o<y<x 



which can be interpreted as follows. Encounters occur with density e~ s , and expending amount y the 
Fighter gains a single hit if he destroys the enemy, which happens with probability a(y). The Fighter 
will gain an expected additional N(x — y,t — s) future hits if he destroys the enemy or otherwise 
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if the enemy's counterattack fails, which happens with probability u. A change of variables then 
yields @. 

By putting both the Bomber and the Fighter in a common general framework, we show that 
the solutions to ^ and ^ exist and are unique and continuous. In particular, the supremum 
is attained in both ^ and ([3]), and hence sup can be replaced by max in each. The optimal 
policy K(x,t) is then defined as the minimal value for which the max in the integrands in ^ and 
(|3| is attained, respectively. 

Recall that a nonnegative function Q(x,t) is totally positive of order 2, written TP 2 (x, t) or 
simply TP 2 , if 

Q(x', t')Q(x, t) > Q(x' } t)Q(x, t') whenever x < x' and t < t', (4) 

and strictly TP 2 if > in Q can be replaced by >. (See |Karlin| ( |1968| ) and the references therein. 
To prove [A] for the Bomber Problem, we establish the TP 2 property of P(x, t) in Section [3] Recall 
also that a log-concave function is a function whose logarithm is concave. 

Theorem 1.1. Let a(y) be a uniformly continuous log-concave function. Then a unique bounded 
solution P(x,t) to equation M) exists, satisfies P(x,t) G [0,1], is continuous and TP 2 . 



Theorem 1.2. If a(y) is a uniformly continuous log-concave function, then [A] holds for the doubly 
continuous Bomber Problem. 



Simons and Yao (1990) claim that [C] can be shown to hold for continuous x and t by arguments 



similar to the ones they provide for a case where both x and t are discrete; in Section [3] we provide 
a rigorous proof of [C] for the doubly continuous case. The discrete x analogues to Theorems |1.1| 
and 1.2 were proved in Samuel (1970). 

Regarding the Fighter in general, we have the following result. 

Theorem 1.3. If a(y) is uniformly continuous, then for any u G [0, 1] a bounded solution N(x,t) 
to equation p|) exists, is unique, satisfies N(x,t) G [0, t), and is continuous. 



For the Fighter Problem we do not resolve the question of whether the general solution to ^ 
is TP 2 , but instead examine two special cases in more detail: 

i) The Frail Fighter: the case u = 0. Once the Frail Fighter fails to shoot down an enemy, he 
himself is shot down with probability one. Equation ^ then simplifies to 

N(x,t)=[ sup a{y)[l + N{x -y,s)]e- {t - s) ds for (x, t) G IR + x R + . (5) 

JO 0<y<x 

Theorem 1.4. If a(y) is a uniformly continuous log-concave function, then the solution N(x,t) is 
TP2, and property [A] holds for the Frail Fighter. 

The Frail Fighter is discussed in Section |4j where [C] is also established. 

ii) The Invincible Fighter: the case u = 1. As the name suggests, the Invincible Fighter cannot 
be shot down. Equation ^ simplifies to 

N(x, t) = [ sup [a(y) + N(x - y, s)}e~ (t ~ s) ds for (x, i)eR+x R+. (6) 
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Theorem 1.5. If a(y) is a uniformly continuous concave function then property [B] holds for the 
Invincible Fighter. 



The Invincible Fighter is discussed in Section [5j where we also show [C] and that the maximum 
y determining K(x, t) is uniquely attained. It should be noted that for none of the problems 
considered here have we managed to show that [A] and [B] hold simultaneously. 

While in the discrete ammunition case one can demonstrate claims by using induction on the 
number of available units (e.g., Simons and Yao, 1990), here we must take a different approach. In 



Section [2] we prove the existence and uniqueness of solutions to equations which have the form of ^ 
or (|3| by following the outline suggested by Weber (Simons and Yao, 1990, p. 431) and construct 
a sequence of functions through an iteration which converges exponentially fast to the solution. 

We illustrate our approach using the Bomber Problem; similar remarks apply to the Fighter. 
First, consider a slightly transformed version of @. For ease of notation, for functions a(-) and 
Q(-,.) let 

(a*Q)(x,s)= sup a(y)Q(x - y, s), (7) 

0<y<x 

the sup-convolution of a(-) and Q(-, s). Letting 



P{x,t) = e t P{x,t), 
substitution into ^ results in the integral equation 



P(x,t) 



(a* P)(x, s)ds + 1 for (x,t) G 



(8) 



(9) 



Clearly there exists a unique, continuous solution P to (J9J) satisfying < P(x, t) < e* if and only if 
there exists a unique, continuous solution P to ^ satisfying < P(x,t) < 1; Theorem 2.1 proves 
the former and provides an iteration method to approximate the solution. Theorem 3.1 provides 
further properties of the solution. 

consider the sequence of functions {P m } m >o generated with 



To prove the claims of Theorem 



3.1 



some initial P^x^t) by the recursion 



m+l 



[x,t) 



(a* P m )(x, s)ds + 1 for m > 0. 



(10) 



In Section l21 by showing that the operation which gives P m +\ from P m is a type of contraction, 



we are able to prove the existence and uniqueness of the solution to (10) by the method of the 
contraction mapping theorem. In Section [3] we prove that various operations preserve the TP 2 
and other properties, allowing us to prove inductively that P m possesses a particular property for 



all m > 0, that may then be inherited by P. We remark in Section[6jwhy this same approach appears 
to fail to give [B]. Nevertheless, the sequence of approximate solutions, which are guaranteed to 



converge in the supremum norm at an exponential rate by Theorem may yet have uses in 
addition to that of proving [A]. 



2 Existence, uniqueness, and approximating sequences 

We will put our models into the following common framework. Given a function a : 1R + — > R + , 
we consider an operation £g> that, for a given function Q : IR + x R + — y IR + , returns a function 
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a®Q: IR + x ]R + — > IR + . Although our results in this section are more general, we will be interested 
in the specific cases where (a £g> Q)(x, t) is one of the following: 



(Bo) 


sun n(inO(T — 11 t) 






0<y<x 




(Fo) 


sup a(?/)[e* + Q(x - 


y,t)} 




0<y<x 




(Fi) 


sup [a(|/)e* + Q{x — 


v,t)) 




0<y<x 




(F u ) 


sup {a{y)e l + [a(y) - 


f u(l 




0<y<x 





i(y))]Q(x-y,t)}. (11) 

Case (Bo) corresponds to the Bomber Problem Q, case (F u ) to the general Fighter equation ^ 
after a rescaling by e* as in (|8]), (F ) the case u = of (i 7 ^), the Frail Fighter, and case (Fi) the 
case u — 1 of (F^), the Invincible Fighter. 

Given a and £g> we will consider operators mapping the collection of functions Q : IR + x IR + — >• M + 
to itself. For the Fighter Problem, these operators will be of the form 



Q(x,t,Q)= [ (a^Q)( y x,s)ds, (12) 
Jo 



and for the Bomber Problem, 



T(x,t,Q) = I (a®Q)(x,s)ds and Q(x, t, Q) = T{x, t, Q) + 1. (13) 



o 



For simplicity, in what follows we may write {?(Q) in place of Q(x, t, Q). For a given function Qo^, £) 
on M + x M + , we study the sequence of iterates of Q given by 

Q m+ i(x,t) = Q(x,t,Q m ) for m > 0. (14) 



The main result of this section, given in Theorems 2.1 and 2.2 proves the existence and uniqueness 
of a solution Q to the equation 

Q(x,t) =G(x,t,Q), (15) 

and the exponential rate of convergence of the sequence Q m to Q when Qo is continuous and a and 
(g) satisfy certain continuity-type properties. These conditions make into a type of contraction, 



allowing us to apply the methods of the contraction mapping theorem (see, for instance, Luenberger 



(1969)) to prove that sequences of functions generated by the iterates of Q on some initial function 
converge to a unique fixed point of Q. 

For a function Q bounded over all compact domains D C M + x M + , let 

\\Q\\ D = sup \Q(y,s)\. 

(y,s)eD 

For any two functions Q and Ft defined on D C IR + x IR + and 5 G [0, oo), let 

dk f ,(Q,i2)= sup |g(x,t)-F(x',t)|, 

{(i,t),(i;',t)eO: |x-x'|<<5} 

and 

dD,a(Q,-R)= sup |Q0M) - i?(a/,OI- 

{(x,t),(a;',t')e-D : |is-a:'|<<S,|t-t'|<(5} 

The functions s and do,s satisfy all the properties of a metric except that they are not necessarily 
zero when Q = R. 
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Definition 2.1. Given a function a(y), the operation ® is of ^-contraction type for some k > 
if, for all compact domains D = [0,X] x [0,T] ; there exist (5 > and 1](5), defined for 5 > and 
satisfying 

7/(0) = and \imr](5) = 0, 

54,0 

such that for any functions Q and R on IR + x M + ; 

^((a ® Q), (a ® i?)) < «d^ 5 (Q, i?) + r/(<5)(||Q|| D V ||i?|| D + /3), (16) 

/or a// 5 G [0, 00) , where by c is the maximum of b and c. The operation (g of contraction type 
if it is of K-contraction type for some k > 0. 



Lemma 2.1. Let Q be given by (12) or (13) for £g> of K-contraction type. Let X>0,T'>T>0 
be arbitrary, and set D' — [0, X] x [0, T'] and D = [0,X] x [0, T]. If Q and R are any functions 
defined on D ' , then 



\\Q{Q) - G{R)\\d> < kT\\Q -R\\d + K(r - T)\\Q - R\\ D ,, 
and when a(y) is bounded, for all 5 > 0, the inequality 

d Dt5 (g(Q),G(R)) < KTd 1 DjS (Q,R)+u(5)(\\Q\\ D V\\R\\ D + 'r) 
holds for some 7 > and u(6) satisfying cj(0) = and \imsiou>(5) = 0. 



(17) 



Proof. Clearly it suffices to prove the claim for Q of the form (12). To obtain (17) let (x,t) G D' ' . 
Applying (16) with 5 = 0, and noting d]j (Q,R) = \\Q — R\\d, we have 

\Q(x,t,Q)-G(x,t,R)\ 



< 



T' 



\(a®Q)(x,s)-(a®R)(x,s)\ds< / \(a ® Q)(x, s) - {a ® R)(x, s)\ds 



\(a®Q)(x,s) 



a (g) R)(x, s)\ds + 



T' 



I (a ® Q)(x, s) — (a (g) R)(x, s)\ds 



tzdp^Q, R)ds + y red^, /)0 ((5, i?)ds 
< kT\\Q-R\\ d + k(T' -T)\\Q-R\\ D ,. 



Taking supremum on the left hand side over (x,t) G D', we obtain (17). 

To obtain (18), let 5 > and suppose (x,t), (x',t') G -D satisfy \x — x'\ < 5 and |t — t'\ < 5; 
assume first that t' > t. Then, applying (16), for each of the four cases of (11) we have 

\g(x',t',Q)-g(x,t,R)\ 



< 



I (a (g Q)(x', s) — (a <g> R)(x, s)\ds 



\(a(g)Q)(x',s)\ds 



< T(Kd^ s (Q,R)+r ] m\Q\\DV\\R\\D) + P)+5\\a\\(e T +\\Q\\ D ), 

where ||a|| is the supremum of a on [0, 00). If we assume that t' < t we obtain a similar bound, 
except that the last term has ||-R||d i n place of Taking the above two cases into account and 

taking supremum on the left hand side, we obtain (18) with 7 = (5 + e T and 00 (5) = Trj(5) + #||a||. 
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Definition 2.2. If Q satisfies the conclusions of Lemma 2.1 for some k > 0, 7 > ; and u)(5) > 0, 



then Q is of ^-contraction type. The operator Q is of contraction type if it is of ' k- contraction type 
for some k > 0. 



Tautologically, under Definition 2.2 Lemma 2.1 says that if Q is given by (12) with ® of con- 



traction type, then Q is of contraction type. 

Proposition 2.1. If Q\ and Q2 are of Ki and ^-contraction type, respectively, then Q\ + Q2 is of 
(k,i + ^-contraction type, and aQ\ is of \q\k\- contraction type for any aeR. Hence the collection 
of contraction type operators form a vector space over R. The constant operator Q(-) = 1 is a 
contraction operator of type . 

Proof. The triangle inequality shows the first claim, the remaining claims are self evident. ■ 



We note that Proposition 2A_ shows that if Q is of contraction type then so is Q + 1. The next 
corollary shows that any Q of contraction type preserves continuity. 



Corollary 2.1. If a(y) is bounded, Q is continuous on 
Q{Q) is continuous. 



and Q is of contraction type, then 



Proof. Given e > 0, by the uniform continuity of Q in any compact domain D of the form 
[0, X] x [0, T], and, since u(5) j. as 5 I 0, there exists 5 > such that nTd^ S (Q,Q) < e/2 



andu(5)(\\Q\\ D + 1 ) <e/2. Hence d D ,s(G(Q), Q{Q)) < e by g§. 
Theorem 2.1. Let Qo(x,t) be any continuous function on I 



x 



" ; and let Q r 



1,2, 



0,1, 



are continuous and 



be given by (14) for some Q of k- contraction type. Then Q m , m 

x 

f x ]R + there exists a constant C > and 



converge uniformly on compact subsets ofM. + x IR + to a continuous function Q that satisfies (15) 

Additionally, for every compact domain D C 
9 e (0, 1) such that 

WQ-QmWo < C9 m for all m = 0,1,.... 

Proof. Let k > as otherwise Q m = for all m > 1 and the result is trivial. Let X > be arbitrary, 
and let T be the supremum over all T > such that there exist C > and 9 G (0, 1) such that 



c mT < C6 m for m 



1,2, 



, where c mjT = \\Q m - Q, 



m-l||[0,X]x[0,T] • 



(19) 



2.1 



We first prove that T = 00. Let 9 G (0, 1). Using (17) of Lemma 
obtain 

c mT > < (^f-) Q m for m = 1, 2, . . . 



with T = and T' = 9/k we 



by induction, first noting that it holds trivially for m — 1. Hence T > 0. 



If (19) holds for some C > 0, $ G (0, 1) and T > then, for T' = T + $/k } using (17) again 

c m ,T' < KTc m -i t T + k(T' — T)c m _i^T' < nTC'd m ~ l + i?c m _ij/ for m > 2. (20) 
The inequality 

Cm.T' < C'm'd m ^ 1 where C' = max{«;TC, Ci^'} 



holds trivially for m = 1, and now induction, using (20), shows it holds for all m > 1. Elementary 



calculus now shows that c m ^> < C'md m 1 for m > 1 implies that for any 9 G ($,1) there exists 



C such that c m ,T' < C9 m for all m > 1. Hence (19) holds when replacing T by T", and therefore 



assuming T < 00 leads to a contradiction. Now note that (19) holds when replacing [0, X] x [0,T] 



S 



D , as D C [0,X] x [0,T] for some X and T 



2.1 



with X" = T 



by any compact £>, and c m ^ by 

Cm,D ||Qm Qm— 1| 

sufficiently large. 

By Corollary 2.1 and induction, the functions Q m , m = 0,1,..., are continuous and by (19) 
they form a Cauchy sequence in the supremum norm on any compact domain D. Therefore Q m , 
m = 0, 1, . . ., converges uniformly on any compact domain to a continuous limit func tion Q. The 
function Q solves (15) as applying the triangle inequality and then (17) of Lemma 
yields 

\\G(Q)-Q\\d < \\G(Q)-Q m+ i\\D + \\Qm + i-Q\\D 
= \\G(Q)-G(Q m )\\D + \\Q m+ i-Q\\D 
< KT\\Q-Q m \\ D + \\Q m+1 -Q\\ D , 

whose right hand side converges to zero as m — > oo. Hence Q(Q) = Q. 
Lastly, by the triangle inequality, for all n > m, by (fl9|) 



WQt 



Qm\\ D <c jr 03 < (r^)^ m+1 ' 



j=m+l 

so letting n — > oo yields the final claim of the theorem. 



Theorem 2.2. If Q is of contraction type, equation (15) has a unique solution that is bounded over 
all compact domains o/lR + x TO + 



Proof. Let Q and R be two solutions to (15) that are bounded over all compact subsets of IR + x M + . 
Let D = [0,X] x [0,T] and D' = [0,X] x [0,T], for some X > and V > T > 0. Taking T = 
and kT < 1 in yields | \Q - R\\ D , = 0. 

Replacing T and T' by X" and T", respectively, in (17), where < k(T" — T') < 1, it is easy to 
see that for the larger domain D" = [0,X] x [0, T"] we now obtain 



\\Q 

This implies that \\Q - 



- R\\d" — \ \S(Q) — G(R)\\d" < «(T" — T')\\Q — R\\d" 
R\ 



(21) 



\D" = 0, and it follows that \\Q — R\\d = holds for any domain 
[0, X] x [0,T], and hence for any compact domain D. m 
In the cases of interest to us here, the operator Q has some additional properties, in particular, 
monotonicity and a type of boundedness. 



Definition 2.3. An operator Q is -B-bounded for a continuous function B : 



x 



— > 



if 



An operator Q is monotone if 



Q <B implies G(Q) < B. 



Q <R implies Q(Q) < Q{R). 



Clearly the operator Q of (12) is monotone for all four choices in (11); hence so is Q of (13) with 
<8> given by case (Bo). The following proposition is immediate from the preceding definitions. 

Proposition 2.2. Let Q be a monotone, B-bounded operator of contraction type, and let Q m , m = 

0, 1, . . be the functions given by (14) when Q (x,t) = 0, and Q' m the functions when Q' (x,t) = 
B(x,t). Then the unique solution Q to (15) satisfies 



< Q m (x, t) < Q(x, t) < Q' m (x, t) < B(x, t) for all m = 0, 1, 



9 



If the iteration (14) is used for numerical approximation of the solution Q to (15), then Propo- 
sition 2.2 allows for the verification of the precision of the calculation, as it provides a lower and 
upper bound for Q; the distance between these bounds therefore gives the approximation error. 

We now show that when a is a bounded function, Q of (12) is of contraction type in all cases of 



(11), and that the same is true for Q of (13) with <g> given in case (Bo). 

Lemma 2.2. Let a : R + — > R + be uniformly continuous and bounded by k. The operator Q given 
by (12) is of k- contraction type in cases (Bo) and (F ) of (11), of 1-contraction type in case (F{), 
and of [(1 — u)k + u]- contraction type in case (F u ). The operator Q given by (13) with £g> as in case 
(Bo) is of k contraction type. 



Proof. For the first claim, with (g> given by case (Bo) of (11 ) it suffices, by Lemma 2.1 , to prove that 
Cg) is of ^-contraction type. Let a compact D = [0, X] x [0, T] and 5 > be given and (x, t), (x', t) G D 
with \x — x'\ < 5. For a given e > let y* G [0,x r ] achieve sup 0<y<x , a(y)Q(x' — y,t) to within e, 
and set y\ = min{y*,x}. Hence 

(a®Q)(x',t) - (a®R)(x,t) 
< a(y*)Q(x' - y*, t) - a(yl)R(x - y* 1: t) + e 

= a(y*)[Q(x' - y*,t) - R(x - yl,t)) + (a(y*) - a(y{))R(x - y^t) + e. 

Since < a(y) < k for all y > and \(x' — y*) — (x — yl)\ < 5, with 

r)(S) = sup \a(y') - a(y)\, 
\y'-y\<8 

we obtain 

(a®Q)(x\t) - (a®R)(x,t) < nd^^Q, R) + r](5)\\R\\ D . 
Similarly, there exists another y* G [0,x] and corresponding y\ G [0,x'\ such that 
(a g> Q)(x\ t)-(a® R)(x, t) > a(y\)Q(x - y\, t) - a(y*)R(x - y*,t)} - e, 



(22) 



which yields a bound of the form (22) with the roles of Q and R interchanged. Since e is arbitrary 

\(a®Q)(x',t) - (a®R)(x,t)\ < k& x DjS (Q, R) + 7]{S){\\Q\\ D V \\R\\ D )- 

Taking supremum on the left hand side and noting that ?7(0) = and lim^o v(3) = by the uniform 
continuity of a(y) yields the desired conclusion. The first and final claims of the lemma are now 
immediate. 

In case (F u ) we have in a similar way 

(a®Q)(x',t) - (a®R)(x,t) 
< atfy + [a(y*) + u(l - a(y*))}Q(x - y*,t) - a(y* 1 )e t - [a(y\) + u(l - a(y\))\R(x -yl,t) + e. 

Adding and subtracting terms as before, we obtain 

(a(y*) - a(y* 1 ))e t + [(1 - u)a(y*) + u] [Q(x - y\ t) - R(x - y* l7 t)] 
+ [(a(y*) - a(yt))(l - u)}R(x - y* u t) + e 
< [(1 - u)k + u)d l DiS {Q,R) + r/(5)e T (|| J R|| D + 1) + e, 

since |(1 — u)a(y*) + u\ < (1 — u)n + u. The result follows as for case (Bo). Now cases (F Q ) and 
(Fi) follow by specializing (F u ) to u = and u — 1, respectively. ■ 
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Lemma 2.3. Let Q be given by (IS) for case (Bo) of (11). If a : R + — > M. + is bounded by k then Q 
is e Kt -bounded. 

Proof. If Q(x, s) < e KS , using that < a(y) < k for all y > 0, we have for all x > 0, 
G(x,t,Q) < k [ sup Q(y, s)ds + 1 < k [ e KS ds + l = e Kt , 

JO 0<y<x Jo 

proving the boundedness claim. ■ 



Lemma 2.4. Consider case (F u ) of (11) with a : M + — > M + bounded by k, and let a = (1 — u)k + u. 



Then Q of (12) is B-bounded where B(x,t) = B a (t) is given by 

B a (t) = 



l-a 



nte 1 a = 1 

e* - e at ) a^l. 



In particular, in case (F ) the operator Q is B K (t) -bounded, and in case (Fi) is nte 1 -bounded. 
Proof. It is easily checked in both the a = 1 and q/1 cases that if Q(x,t) < B a (t), then 



Q{x,t,Q)< / (Ke s + aB a (s))ds = B a (t). 
'o 



The following corollary summarizes the results above. 



Corollary 2.2. Let a : 



be uniformly continuous and bounded by k. Then, with Q given by 



(12) and ® any of the four cases of (11), or Q given by (13) with (g) given in case (Bo) of (11), there 



exists a continuous solution to the equation G(Q) = Q, and there are no other solutions bounded 
over compact domains. Moreover, with Qo(x,t) any continuous function from M + x M + to 1R + , the 
sequence of iterates of Q given by Q m +i = Q(Qm) form > converges uniformly to the solution 
of Q(Q) = Q at an exponential rate. For every m, the solution to Q(Q) = Q is bounded below by 
the m th term of the sequence initialized with Q (x,t) = 0, and if Q is B-bounded, then it is also 
bounded above by the m th term of the sequence initialized with Q Q (x,t) = B(x,t). 



We conclude this section with a proof of Theorem 1.3 



Proof of Theorem 1.3, Let Q be given by (12) and £2> by (F u ) of (11) for u G [0, 1]. By Lemma [2T2 



when a is a probability, the operator Q is te -bounded. By Corollary 2.2 the unique solution iV to 



G(Q) = Q exists, is continuous and satisfies < N(x,t) < te 1 . Now letting N(x,t) = e l N(x,t) as 
in pi), we have N(x,t) E [0, £], as claimed. ■ 



3 The Bomber 

In this section we consider the dynamic programming equation (|9]), and specialize the results of 
the previous section to <8> given by case (Bo) of (11). Let F(Q) and Q(Q) be given by (13). In 
particular, equation ([9J may be written more compactly as Q(P) = P. Throughout this section a(y) 
can be interpreted as the probability of the Bomber surviving an enemy encounter after expending 
an amount y of its ammunition, although our results hold in greater generality, in particular, for any 
bounded log-concave a : M + — > M + . We require strict log-concavity for Theorem 3.2 For example, 
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the function a(y) in ([!]) is strictly log-concave in y > for any u < 1, being the composition of a 
strictly concave function and a strictly increasing and concave function, the log. 



We show that T and Q preserve TP 2 and other properties, which are used to prove Theorem 1.2 
that [A] holds for the Bomber problem. The Fighter Problems that we treat in subsequent sections 
have much in common with the present one. We begin by collecting some facts about TP 2 and 
log concave functions in the following lemma; the claims which cannot be easily verified using 
definition Q can be found in Karlin (1968). For part 1 of Lemma 3.1 see also Schoenberg (1951). 



Note also that part 2 is a special case of part 3, and that the second conclusion of part 5 follows 
from part 4 after noting that a function f[x) of the single variable x, or g(y) of y, is TP 2 (x,y). 

Lemma 3.1. 1. A nonnegative function a(y) is (strictly) log-concave if and only if a(x — y) is 
(strictly) TP 2 (x,y). 

2. The convolution of log-concave functions is log-concave. 

3. (The composition formula) If J(x,y) is TP 2 (x,y), L(y,z) is TP 2 (y,z), a is a nonnega- 
tive sigma-finite measure on M, and M(x,z) = J J(x,y)L(y, z)da(y) exists, then M(x,z) 
is TP 2 (x, z). 

4- If J(x,y) and L(x,y) are TP 2 (x,y), then so is their product. 

5. If J(x, y) is TP 2 (x, y) then J(x, y) p for any positive p, and J(x, y)f(x)g(y) for any nonnegative 
functions f and g, are TP 2 . 

Given a TP 2 function Q defined on IR + x IR + we extend it to M x M by setting it equal to zero 
where it was not defined before; the resulting function is TP 2 on R x R. The next lemma follows 



directly from (12) and (13) 



Lemma 3.2. // a : IR + — > IR + and Q(x,t) is nonnegative and increasing in x then T(Q) and 
G(Q) = J^iQ) + 1 are nonnegative and increasing in x and t. 

The following key lemma gives conditions under which the TP 2 property is preserved by the 



sup-convolution. We recall that <g> in this section is given by (Bo) of (11) 



Lemma 3.3. If Q is a continuous, nonnegative TP 2 function on IR + x IR + and a : IR + — > IR + is 
log-concave, then a®Q is TP 2 . 

Proof. Let (x, t) G IR + x IR + and p > be arbitrary. Making the change of variable v = x — y and 
writing the limits of integration using the indicator I(x,v) = 1(0 < v < x) we obtain 



[a(y)Q(x — y, s)] p dy = / a(x — v) p I(x, v )Q(v, s) p dv. 

J —oo 

One can verify directly from Q that I(x,v) is TP 2 (x,f). Since a(x) is log-concave on IR + , defining 
a(x) = for x < we have a(x) log-concave on all of E, and so the product a(x — v)I(x,v), 
and therefore also a(x — v) p I(x,v), are TP 2 (x,t>) on I x 1. Hence the integrand is a product 
of a TP 2 (x,v) function with a TP 2 (v, s) function, and so the integral is TP 2 (x,s) by part 3 (the 



composition formula) of Lemma 3.1[ Raising to the power 1/p, we therefore have 

i/p 



J [a(y)Q(x - y, s)] p dyj is TP 2 (x, s) for all p > 0. (23) 
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Since a(y) is log-concave on M + it is continuous in (0,x] and bounded on [0,2;], with a possible 
discontinuity at 0, in which case there is a downward jump. Hence for all fixed x and s the product 



a(y)Q(x — y, s) has the same properties. Therefore the limit of the L p norms (23) of the function 
a(y)Q(x — y, s) of y on [0, x\ converges to its essential supremum which coincides with its maximum 
value over y. Using the nonnegativity of a(-) and Q(-, •), we therefore have, by the preservation of 
the TP 2 property under limits, that 

(rx \ 1/p 

/ [a(y)Q(x - y, s)] p dy ) = (a® Q)(x, s) is TP 2 (x, s). 
Jo J 



Lemma 3.4. If a : R + — > M. + is log-concave and Q is TP 2 then J^{Q) is TP 2 . 



Proof. By Lemma 3.3 (a <g) Q) (x, s) is TP 2 (a;, s). As I(s,t) = 1(0 < s < t) is TP 2 (s,t), the integral 
of the product 



pt poo 

F(x,t,Q) = / (a <8> Q)(x, s)ds = / (a <g> Q)(x, s)I(s,t)ds, 

JO J-oo 

isTP 2 (x,t). ■ 
Lemma 3.5. IfQ(x,t) is nonnegative, increasing in x and t, and TP 2 , then so is Q(x,t) + 1. 

Proof. It is clear that Q(x,t) + 1 is nonnegative and increasing in x and t whenever Q(x,t) is. To 
demonstrate the TP 2 property it is required to show that 

(Q(z',0 + 1)(Q0M) + 1) > (Q(x',t) + l){Q{x,t') + 1), 

where x' > x and t' > t. The monotonicity and nonnegativity of Q imply that the result is trivial 
if Q(x',t') = 0. Otherwise using Q(x' ,t')Q(x,t) > Q(x', t)Q(x, t') we obtain 

(Q(x',t') + l)(Q(x,t) + 1) - (Q(x',t) + \){Q{x,t') + 1) 

> (Q(x' 7 t f ) + i)( Q{x 'qP^ ] + 1) - (QW,t) + l)(Q(x,t') + 1) 

= {Q{x',t')-Q(x\t))(Q(x\t')-Q(x,t'))/Q{x\t') >0 

where the last inequality follows since 

Q(x',t') > m&x{Q(x',t),Q(x,t')}, 

as Q is increasing in both x and t. m 

Theorem 3.1. If a : IR + — > IR + is a uniformly continuous log-concave function then the solution P 
to Q(Q) = Q is TP 2 . 

Proof. Let Po = and P m +i = G(P m ) for m = 1, 2, We first claim that the functions {P m }m=o 

are nonnegative, increasing in both x and t, and TP 2 . Clearly the claim is true for P . Assume 



the claim is true for P m for some m > 0. By Lemma 3.2 J(P m ) and P m +i are n onnegative 



and increasing in x and t, and by Lemma 3.4 J-"(P m ) is TP 2 , and now Lemma 3.5 shows that 



Pm+i = J^iPm) + 1 is TP 2 , thus completi ng th e proof of the claim. That P is TP 2 follows, as 



P m converges uniformly to P by Corollary 2.2, and the TP 2 property is preserved under (even) 
pointwise limits. ■ 
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We may now prove Theorem 



when a is a probability, the operator Q is of 1- 
the unique solution P to Q(Q) = Q exists, is 



2.2 



Proof of Theorem 1.1 By Lemmas |2.3| and 2^ 
contraction type and e'-bounded. By Corollary 

continuous and satisfies < P(x, t) < e*. Now recalling (Jsj) , that is, that P(x,t) = e t P(x,t) , we 
have P(x, t) E [0, 1]. Theorem 3.1 gives that P is TP2, hence P is TP2 by Property 5 of Lemma 3.1 



The next lemma modifies the result in Samuel (1970), page 158, to continuous ammunition and 



time, thus allowing us to show Theorem 1.2 



Lemma 3.6. Let R(x, z,t) be a positive continuous function of x > z > and t > such that the 
ratio R(x, z, t)/R(x, z', t) is increasing in t whenever x > z' > z > 0, and let 

k(x, t) = mm{y E [0, x] : R(x, y, t) = max R(x, z, t)}. 

0<z<x 

Then k(x,t) is decreasing in t. 

Proof. For the sake of contradiction, assume that there exist ti < t 2 and Z\ < z 2 < x such that 
k(x, ti) = z\ < Z2 = k(x,t2)- Then the first equality gives R(x, zi, t\)/R(x, z 2 , ti) > 1, as the maxi- 
mum of R(x, z, ti) is attained at z = zi, whereas the second equality gives R(x, zi, t 2 )/R(x, Z2,t 2 ) < 
1 as k(x,t 2 ) is the minimum over all y which attain the maximum of R(x,z,t 2 ). This contradicts 
the assumption that R(x, z,t)/ R(x, z', t) is increasing in t. m 

Proof of Theorem 1.2. By Theorem |l.l| the solution P(x, t) of ^ is TP 2 ; also from ([2]), P(x, t) > e - ' 
for all (x, t) E 1R + x]R + . In view of definition Q, the ratio P(x', t)/P(x, t) is increasing in t whenever 
x < x', or 

p ( x - ^ f ) _ j a(z)P(x - z, t) 



P(x-z',t) 



and therefore 



a(z')P(x - z',t) 



is increasing in t when < z < z' < x. Applying Lemma 3^ with the continuous function 
R(x, z, t) = a(z)P(x — z, t) now yields that 



K(x, t) = min{y E [0, x] : a(y)P(x — y,t) = max a(z)P(x — z,t)} 

0<z<x 



(24) 



is decreasing in t, and [A] holds. ■ 
We now consider [C] for the Bomber. 

Theorem 3.2. If a : IR + — > IR + is a strictly log-concave function, then conjecture [C] holds for the 
doubly continuous Bomber Problem. 

Proof. For < y < x and 5 = x — y note that [C], that is, x — K(x, t) >y — K(y, t), is equivalent 
to 

K(y + 5,t)<K(y,t) + 5. (25) 



Inequality (25) holds trivially for all y such that K(y + 5,t) < 5. To handle the case K(y + 8,t) > 5, 
define 

a(x) 

H X ,V) = -ft and G x (y,t) = a(y)P(x-y,t), 

a{y) 
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the latter expression being the conditional probability of survival upon expending an amount y of 
ammunition at an encounter at time t, when the total amount x is available, and then proceeding 
optimally thereafter. With these definitions in place we obtain 



Gy+s(v + 5,t) = a(v + 5)P{y - v, t) 



a[v 



a(v 



G y (v, t) = b{v + 5, v)G y (v, t). 



(26) 



Rewriting (26) and using that K(x,t) is optimal, we have 

G y+ s(v + 8,t) 



Gy(v,t) 



< 



b(v + 5, v) 
G y+s (K(y + 5,t),t) 

b(v + 5, v) 
G y+s ([K(y + 5,t)-5]+5,t) 
b(v + 5, v) 

G y (K(y + S,t)-S,t) 



b(K(y + S,t),K(y + 5,t)-5) 
b(v + S, v) 



(27) 



where in the third expression we use K(y + 5,t) > 5, and obtain the last equality by applying (26) 
with v = K(x, t) — 5. 

By part 1 of Lemma 3.1 a(y) is strictly TP2, which is equivalent to b(x + S,x) being a strictly 
decreasing function of x for x > 0. Therefore, for v satisfying v < K(y + S,t) — 5, we have 



b(K(y + S,t),K(y + S,t)-5) 



< 1. 



b(v + 5, v) 

Since K(x, t) is the minimal amount of ammunition that can be used to proceed optimally, if the 
smallest maximizer of the left hand side of (27) is attained at a value of v — K(y,t) satisfying 
v + 5 < K(y + 5,t), the ratio of the 6-functions on the right hand side of (27) would be strictly less 
than 1. In this case, by (27), K(y + 6,t) — 5 would be a better choice for v than the optimal amount 
K(y, t). Note that by definition K(y + 6, t) < y + 5, so K(y + S,t) — 5 < y, and hence is a feasible 
quantity to expend, given ammunition y. Having reached a contradiction, we conclude 

K(y,t) + 5>K(y + 5,t), 



which is (25 ). 



4 The Frail Fighter 



In this section we consider the Frail Fighter, whose goal is to shoot down as many of the enemy 
planes as possible. Recall that if the Frail Fighter does not shoot down an encountered enemy, then 
he gets shot down with probability 1. In this section letting <g> be given by case (F ) of (11), the 
dynamic programming equation (J5J for the Frail Fighter can be written N(x,t) = Q(x,t,N) for 
Q(x,t,Q) given by (12) and N(x,t) = e t N(x,t). Analogous to the previous section, in this and the 



next section a(y) can be interpreted as the probability that the Fighter destroys an enemy using an 
amount y of ammunition, although our results hold for more general a. 



The following result is parallel to Lemma 3.4 
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Lemma 4.1. If e t Q(x,t) is nonnegative and increasing in x andt then so is e t Q{Q). If a : R + — > 
R + is log-concave and Q is TP 2 (x,t) then so is Q{Q). 

Proof. It is clear that e~ l Q(Q) is nonnegative and increasing in x whenever e~ l Q is. Next, 



dt 



sup a(y)[l + e-*g(a?-3/,t)]-e-*0(g) 

0<y<x 



(2f 



= /(*)-/ /(s)e" ( '- s) ds where /(t) = sup a(y)[l + e"*Q(x - y, t)}. 

Jo 0<j/<x 

Since e _t Q(x,t) is increasing in t, f(t) > f(s) for all s £ [0, t], and 

/(*) > (1 - e"*)/(t) = f f(t)e-^ds > f f(s)e-^ds. 



Hence the partial derivative (28) is nonnegative, and e t G(Q) is increasing in t. 



As <3(x, i) is TP 2 , so is e t Q(x, t) by Lemma 3.1 Now, by Lemma 3^5} 1+e t Q(x, t) is TP 2 (x,t). 
As in the proof of Lemma 3.3| letting p > and I(x, v) = 1(0 < v < x), write 



(y) p [l + e- s Q(x-y,s)} p dy = / a(x - w) p J(x, v)[l + e~ s Q(v, s)} p dv : 



which is TP2(x, s), as in the proof of Lemma 3.3 Taking p th roots and letting p — > oo we conclude 
that sup 0<y<x a(y)[l + e~ s Q(x — y, s)], and therefore also sup 0<2/<a . a(y)[l + e~ s Q(x — y, s)]e s , are 
TP 2 (a;,s)rNow 

i*t poo 

/ sup a(y)[l + e~ s Q(x — y, s)]e s ds = / sup a(y)[l + e~ s Q(x — y, s)]I(s, t)e s ds, 

JO 0<y<x J -oo o<y<x 

and the final claim follows. ■ 
The proof of Theorem 4.1, which proves the first claim of Theorem 1.4, is similar to the proof 
of Theorem 13.11 and is omitted. 

Theorem 4.1. If a : IR + — > IR + is a uniformly continuous log-concave function then the solution 
N(x,t) to G{Q) = Q is TP 2 , as is N(x,t) = e~ t N{x,t). 

The Frail Fighter's optimal policy K(x, t) satisfies 

K(x, t) = min{y £ [0, x] : a(y) [1 + N(x - y, t)] = sup a(z) [1 + N(x - z, t)]}. 

0<z<x 



Applying Lemma 3.6 with R(x, z, t) = a(z) [1 + N(x — z, t)] we obtain [A] for the Frail Fighter, thus 
proving the last claim of Theorem |1.4| 

We now prove that [C] holds for the Frail Fighter. 

Theorem 4.2. If a : 1R + — > IR + is a strictly log-concave function, then conjecture [C] holds for the 
Frail Fighter. 
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Proof. The argument is nearly identical to the proof of Theorem 3^, and again it suffices to only 
consider y for which K(y + S,t) > 5. Let 



b(x,y) 



a\x) 



a(y) 



and G x (y,t) = a(y)[l + N(x - y,t)], 



the latter expression being the expected 'score' for the Fighter expending y, conditional upon an 
encounter at time t when a total amount x is available, and then proceeding optimally thereafter. 
With these definitions in place we obtain 

G y+s (v + 5,t) = a(v + 8)[l + N(y-v,t)} = °^^-G y (v,t) = b{v + 8,v)G y (v,t). 



The same lines of argument of Theorem 3.2 from (26 ) on may now be applied to yield the conclusion. 



5 The Invincible Fighter 

In this section we consider an Invincible Fighter who cannot be shot down, whose goal is to shoot 
down as many of the enemy planes as possible. Hence, in this section we take Q given by (12) and 
® by case (Fi) of (11), and the relevant equation may be written N(x,t) = Q(x,t,N). The role of 
the next lemma, and its proof, are parallel to that of Lemma 3J3 in Section [3j 

Lemma 5.1. If f(x) and g(x) are log-concave functions, then so is 

h(x) = sup [f(y)g(x - y)\. 

0<y<x 

If f(x) and g(x) are concave functions, then so is 



h(x) = sup [f(y) + g(x - y)\. 

0<y<x 



Proof. By Lemma |3.1| part 2, the convolution of log-concave functions is log-concave. Writing 

h(x) 



lim 

p— >oo 



\f(v)g{x-v)] p dy) ■ 



and noting that log-concavity is preserved when taking powers and under pointwise limits, we 
conclude that h(x) is log-concave, thus proving the first claim. To prove the second claim, write 
h(x) = logsupfx^fe^^e 51 ^ - ^] and apply the first result to the log-concave functions and 



The proof of the following theorem uses the second part of Lemma 5.1 to show that concavity 
is preserved under the operation of (Fi) of (11), and then an iteration and limit argument as in the 
proof of Theorem 3.1 The details are omitted. 



Theorem 5.1. If a : 



— > 



is a uniformly continuous concave function then the solution N(x, t) 



to the equation G(Q) = Q, for Q given in (12) for case (Fi) of (11), is concave in x for every t, as 
is N(x,t) = e' t N{x,t). 



The following lemma is similar to Lemma 3.6 
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Lemma 5.2. If R(x,y) is a continuous function and R(x,y') — R(x,y) is increasing in x for all 
y' > y, then 

k{x) — inf {y : R(x, y) — sup R(x, z)} 

0<z<x 

is increasing in x. 

Proof. To reach a contradiction, assume there exist x < x' such that y' = k(x) > k(x') = y. Note 
then that by the definition of k we have 

R(x, y') = R(x, k(x)) > R(x, k(x')) = R(x, y) and R{x', y') = R(x', k(x)) < R{x', k{x')) = R(x', y), 
contradicting the assumption on R. m 



We may now provide the proof of Theorem 1.5 



Proof of Theorem 1.5. For fixed t, let 

R{x,y)=a{y) + N{x-y,t). 

Note that R(x, y') — R(x, y) being increasing in x for all y' > y is equivalent to N(x — y') — N(x — y) 
being increasing in x for all y' > y, which is equivalent to iV being concave in x. Applying Theorem 



5.1 and Lemma 5J2 completes the proof. ■ 
The optimal policy for the Invincible Fighter is given by 

K(x, t) = arg max [a(y) + N(x — y, t)] . (29) 

0<y<x 

Proposition 5.1. // the uniformly continuous function a : IR + — > IR + is strictly concave then the 
optimal policy K(x,t) for the Invincible Fighter is unique, that is, the maximum in (29) is attained 
uniquely. 



Proof. Theorem 5.1 gives that N(x, t) is concave in x for every t, and hence N(x — y, t) is concave 
in y for all fixed x and t. Since a{y) is strictly concave in y, so is the function a(y) + N(x — y,t), 
and hence its maximum is attained uniquely. ■ 
The argument we have used here to show uniqueness no longer works in general in the model 
(F u ) where the Fighter is vulnerable to attack, where, following (|3]), the function R(x,y) in the 
proof of Theorem L5 is replaced by 

R(x, y) = a(y) + [a(y) + u(l - a(y))]N(x -y,t). 

In this case, R(x, y')—R(x, y) being increasing in x for y < y' is no longer equivalent to the concavity 
of N(x, t) in x for fixed t when a / 1. 

We now prove that [C] holds for the Invincible Fighter. 

Theorem 5.2. // the uniformly continuous function a : M + — > IR + is strictly concave, then conjec- 
ture [C] holds for the Invincible Fighter. 



Proof. The argument is similar to the proof of Theorem 3.2 As there, it suffices to only consider 
y for which K(y + 5, t) > 5. Define 

b(x,y) = exp(a(x) - a(y)) and G x (y, t) = exp(a(y) + N(x - y, t)), 
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the logarithm of the latter expression being the expected 'score' for the Fighter expending y, con- 
ditional upon an encounter, at time t, when a total amount x is available, and then proceeding 
optimally thereafter. With these definitions in place we obtain 

Gy+sip + S,t) = b(v + 5, v)G y (v, t), 



and the lines of argument of the proof of Theorem |3.2| may now be followed to show the desired 
conclusion under the condition that exp(a(a;)) is strictly log-concave, that is, that a(x) is strictly 
concave. ■ 



6 Discussion 

We have demonstrated that [A] holds for the Bomber and Frail Fighter, [B] for the Invincible 
Fighter, and [C] for all three, so in no model have we shown that [A] and [B] hold together. In 
addition, we have shown uniqueness of the optimal policy only for the Invincible Fighter. But of 
all the possible conjectures which can be raised in these models, the one most outstanding is that 
[B] holds for the Bomber, and naturally one may hope to use the ideas developed in Sections [2] and 
[3] to settle this. 
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Figure 1. The functions log P m (x, t), m — 1, . . . , 10, for t — 10. 



The equivalence of [B] to the log-concavity of P(x,t) in x was noted in Simons and Yao (1990) 
Hence, parallel to the proof of [A], for a given Q(x, s) consider the function 



R(x,t) 



(a <S> Q)(x, s)ds 
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Figure 2. The functions logP m (x, t), m — 1, ... ,7. 



where ® is the max-convolution operator given in case {Bo) of (11). By using results in Prekopa 



( |1973[ ), one can show that R(x,t) is log-concave when a(y) and Q(x,t) are log-concave, similarly 

itive 

(30) 



as to how one shows that the TP 2 is preserved. When R(x, t) is log-concave, for any nonnegative 
xi,x 2 , ti, t 2 , we have 

R\2 — R1R2 or R12 > (R\R2) 1 ^ 2 



where 



R 
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Xi + x 2 ti+ t 2 



Rx — R(xi, ti) and R 2 = R(x 2 , t 2 ) 



Now to proceed as in Lemma 3.5, for R(x,t) + 1 to be log-concave, we require that 

(R12 + l) 2 > (Ri + 1) (R2 + 1) , 



and by (30) it suffices that 



2R 12 >Ri + R 2 or R 12 >^(Ri + R2) 



(31) 



that is, that R(x, t) is concave. However, unlike the argument in the proof of Lemma 3.5 



we cannot 



conclude (31) from (30) even though the converse is true. The geometric mean of R\ and R2 in 
(30) is in general smaller than the arithmetic mean in (31 ). Moreover, numerical evidence indicates 
that R(x, t) may fail to be concave. 

Nevertheless, as the concavity of R(x,t) is sufficient but not necessary for the log-concavity 
of R(x,t) + 1, log-concavity may yet be conserved in each step of the iteration, and the limiting 
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argument pushed through as before. Taking a(y) to be given in Q and considering the first few 
iterates of (10), one has P (x,t) = and Pi(x,t) = 1, which are indeed log-concave. Continuing, 



as a(y) is increasing we have (a <E> l)(x, s) = snp 0<y<x a(y) = a(x), and therefore 

P 2 (x,t)= f (a®Pi)(x,s)ds + l= [ a(x)ds + 1 = ta(x) + 1. 
Jo Jo 

Since 

d 2 — —t(l + t)(l — u)e~ x 

^lo g P 2 (x,t) = V, , " J ^ fOT a11 OM) G R+ x R+ ' 

the function P2(x,t) is log-concave as well. Indeed, Figure 1, which gives plots of logP m for 
m — 1, . . . , 10, (sc, t) G [0, 10] x {10}, and tt = 0, suggests that log-concavity is preserved in these 
further functions as well. The figure also indicates that convergence of P m (x,t) for the values 



considered is quite rapid, consistent with the exponential bound in Theorem 2.1 Expanding the 
range of t back toward the origin, Figure 2 depicts log P m (x,i) form = 1, . . . , 7 over the range 
(x,t) G [0, 10] 2 , and indicates that these functions are log-concave in both variables x and t. 
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